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Introduction 



I«od«ctHm of handwriting aThSSmSS^K'^Z^f?*'^ mconsistencies inflie 
using domain-specific hiowlcd^ ' niefliods for unpiovuig seaich accuracy 

SnenTSu^^ a mZe^ If no^I^- r""*^ .infonnation a« valuable. Thfe 
^^^^^^^^ cusses a number of novel techmques for miproving tfae accuracy of digital ink 
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1^ Digital Ink Definition 

contort with a dawfag siiSS^ ^SS^rr *at beg^, ^hen the pen d«jvice makes 

sampled coonlimr^flr^LT't^totS^ 

drawingsmfece. movenKaii or tbe pen whilst the pen is m contact with the 

1.3 Digital Ink Searching 

The traditional method of searching handwritten data U #o ^ ^ *u . . . . 

shape. AMdoMlh. to ITlJ^^ L^) l»«d»nMn »ilh . di»l of sfoilari^ to 
todh*i».lch«««SSlSSS^* ^ (P«t«»laily curt, .rtd,^). to |dmific«ioSof 

ta^^^Sl^SLtfjrSl'r'^.'^^ • of di^ tok fcr 
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Digital Ink Search Applications ' 

s« of ^ fett^ [lir^^ ^ ^ """^ ~°'»^ • <'»»i^ ^ toiO" or 
DetdUed Deacriptiaii ofOie Preferred Embodiments 

WO0214075 "Interface Surfece SnteTSSSSv^S^.^ 2? F^U^^^St '^'^^'^ 
Syntfa^^is" filed 24 2W3 ^be^SiSd S?"^. Searching Using Handwriting Feature 

pen. Each pase eenerated hv wll!^ ®f Of invisibly coded paper and an optically imaging 

server. a^dTufr^tiL^rthe'STSi^tS^^ ^ 

stored. Digital printinTtecSotoS &SL^ ^^^F '^J^ interpreted, and 

Ey e-oMS^^lr^tJ^^^TSS 5"™ "Ho"? »»P»lstl«««i appUc.ao«i u b« developed 



2 Domain-Specific Specialization 

or cursive handwS UtiS?^e5?^?Sft n??; tl,^ ^fT"^ ""^^ ""^^ P^'^ 
drawn pictures. Similarly systeS ^ :. ?v ? ^^^^ techmcpies for searching hand- 

types of digital inlc^diT^J^ '"^'^g o*er specific 

el^ons. ^'^"^^'^ ^^^'^ handwntten characters, technical drawings, or handiawn 

S^S-iSSTd^ °r ^ -"^^ greater accuracy 
specific knowle^e y^d^^^TV^^' arc able to utilize domain- 

Sc fonnat S^u^^^Son oft^^^^ "l^T"^- ^""^^''ee of the expected digiSl 
the pattern primitivr^rfe g sS-oL^ pi«-ptocessing and normalization, 

feature set. L matSi^dgoriCSe SE^m^S'f?"^' -•^^''^ 
digital ink searching „si^ s^eciaStS^ ^ ""^^ "^"^ P^^^"™ 

2.1 Specialization Examples 

. cwSSo^f^Ej^^'S:^^ ^ «o «^loit the key 

descender elements (eT-SS^S^^? a. of ascender and 

lines and core lines^ IS ^SZ^hkoSZZt ' -'^"^ <b«» 
writing of a single autbort aSSL Wrf. wT^r .handwntten strokes (at least within the 
expectetion that L iSfwUl t cS^S^ ?^ information can also be utilized, such as the 
^kes representingCdf ^ Ut^ T^^TJf^T^'^^^^ linear lines that contain groups of 
matching digital i^^ZX ^^^.^^^T^i. ^ ^^^^ ^ ^ 
consistently, being welllSn^^ uit^SZs'^^' ^^^."^ 
S^^lizcd search s^tegies^ also^jl^ssWhrwrS^ Xl^'^%J^^ 

Stitly'^diff^S^mo^oJ^S^^,'-^^^ scribbles a« 
available. Han*drawn pictare 2l ""^'"'^ of handwriting are not 

insensitive, due toTLSrS^e^Tf diS^v^r'' '^'""'^ sHoke direction 

algorithm must also be3ti3v faLtS^ ^ P"'*^ ""^ QeneraUy. the 

on% page. To imTro,^ aSSSc^SS*^^ "^'^ ""^^'^O'^ 

are rendered using an aggreration lfHnt^J?T "^'^"^ "»y exP^it the feet that most drawings 
inrage into a cano S^S^^r^'S^eytrC"*^ -»y be used to decompose I 

techniques that have been dS^SSISr f"^** '^'^"'^ segmentation 

Ai8. they may exploit thelS^t £°SS£^^.'^T'^°'' '^'T f^^^' ^ ^^'^^^^ 
primitive radicals, whilst compaii for CS^H^^f f^*^^ ««°Po«5d ftom a smaU set of 
during writing. «»npensatmg for the potentially hirge strokeK)rder variation that can occur 

^S^aSl£t"lSL^L *T ^ -^"^ - '---o™- equations. 

An awareness ofSe" SK^e^t^^^^^^^^ ^"T"* <««^t««y features, 

fiom information, and th«spr<^5:t^^^S^rsS^^^^^^ 

2J2 Using Specialized Searching 

level; for example. a ^t^lkS^^^rS^L^S?^^ ^ "f!^^ ^' « 

character searching depending on die «r —.^f 7 "*";^"Pt searching or oriental 

tius decision to be made SmticX^ V/^t T'^ °f ^ P^^^^Je for 

between Utin-based andSSTsSSts 1^2^' SSl°C "^''"'^ differentiate 
fiomhand-drawing nnages ^ ^ techmques exist to dififerentiate written text 
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A more flexible system allows individual segments of digital ink to be labeUed as a specific digital 
^ type and subsequently searched using algorithms specialized for that particu£ F^J 
ex^p^e the system may aUow a user to indicate that they geneiaUy write using a specScl^guTge 
nfo'™,.? ^ k' ^^T^ r printed: upper-case! or^S) aJfZ 

mformauon can be used to select the appropriate ink seaicWng mlchSsm. In addition to S T> 

2^^^^ ^ a number of dififeient pens (e.g. one for handwriting text and another for Sne 

AMlher^roach to specialized digital ink searching is to require die manual selection of the search 
SS^Ji^Sriext Jirj-^r^^ examplclfl user wishes t,;"2^h fiJ^^J 

^S^t:£iSi.""^^ of the ink search may justify the increased resource utilization 

Specialization Using Context Information 

^iq^cSLt d?^d r^SslfT^ 'f'^' ^ ^^^^^ 

the ink was written^ a« ^T^ri • i w ^ ™ contents of the page or document on which 
Lugaage/Script Ideotiflcatiaii 



<imft. lang^^en" dir=''rtl''></HTML> 



whei left-to-nght ( Itr"). another assumed characteristic of the digital ink that can bTused 

when performmg digital ink searching. Sunilarly. in the XMUXPO^^T^!,^ . ^ • « 
special attribute named «xml:lang" miy heS^iJi^J^^f^ ^^l^*^ specification "a 
contents and attribute values of a?y e"Si«tiSSiS^^.?4r'^ "^"^^^ " ^« 



<TITLB acinXaang--fr">XPorTOS en XHTMI.</TITLB> 



(thus sp^ifying the lang^ S CmL 2^^^ ."""I "\ 

content seq^L: document), in any structured element, or in marked- 



/apan « /Lang (fr) » 

BDC 

(Bonjour.) Tj 

EMC 



ll» sl»icla«l laiism,r372 11 rSiiT^ *• jmenBe asaxiialed Mlb a raonica using 
doeimoTdSlI D«onpOm IWwotfc. «Kl can b. ««d «iih HTML and XML 

signage sc.4.tTu:S.;«'S?o^a^^S,^^ ^-^^^^^ of .he 



Field Labels 



labels with data entrv reni^fr^ u f^*T.'*S«o" V analysing the fonn description to associate 

Sd fieSl^7sS^is^S to Alf "^^^ "^"^r ^""^ * "^"^ of previously 
corresponding ink iyp3a^1^ll 2,^^^^ ^8"^ expression matching) and (he 



Ink Type 


Field Label 


Text 


iTl^^'^^'l''''^^^' Surname, Family Name. Address, Suburb, Town. 
State, Countiy, Region. Email Address ' ^ 


Numeric 


cS^t pS'm "^.f^^ Zip Code, Post Code, Date, Time. 
Credit Card Number, Customer Number » » * 


Drawing 


Picture, Drawing, Image, Diagram 
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3.3 Field Attributes 



In addition to the field type, fonn definitions often contain information regarding the type of data that 
should be entered in each field. This information is usually contained in attributes that are associated 
with a specific field. For example, some input field types have a flag indicating that the value entered 
must be nmneric. A digital ink searching system can use this information to select a numeric search 
strategy for ink contained in the associated data input area. 

In addition to using standard form field attributes to improve the accuracy of digital ink searching, 
digital ink search specific information can be added to fields using custom attributes. This 
mformation is only used if the document is processed using a digital ink searching system; the 
document can still be used normally where required (e.g. printed or displayed in web browser) since 
processmg systems generally ignore the unrecognised custom attributes. However, if digital ink 
searching is required, the custom parameters can be used to 'msprove the accuracy of the search 
results. 



4 Conclusion 



A number of techniques to improve the accuracy of digital ink search were discussed, including a 
method of selecting a digital ink searching strategy from a set of specialized strategies based on the 
expected ink data type. Examples of specialized digital ink searching strategies were given along 
with a number of methods for integratmg these strategies into a system. In addition to this, metfiods 
for selectmg digital ink search strategies based on die layout and definition of a document was 
discussed. 
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5 Figures 




Results 



Figure 1. Digital Ikik Searciiing Using Spedallzatloa 
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